Image displaying method and image displaying apparatus

ABSTRACT

In a slide show, image displaying method and apparatus are provided that can automatically set a display effect suitable for a picture on the basis of information proper to individual pictures. After at least one image data is obtained, in executing a slide show of this image, characteristic areas such as faces in the image are detected, and a display effect is selected from a plurality of predetermined display effects on the basis of the number and/or size of the characteristic areas. The image is displayed while being changed in time series on the basis of this selected display effect.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image displaying method and an imagedisplaying apparatus, and is in particular suitable when applied to animage displaying apparatus that displays image data on a screen.

2. Description of the Related Art

Digital high vision broadcast has been started and, by the spread oftelevision receiving apparatus conforming to high vision, one can enjoyvideo images having a higher image quality and being more impressivethan before, at home. On the other hand, by the spread of electronicstill cameras, an increasing number of users are enjoying digitizedstill images and moving images by displaying the images not only on apersonal computer screen but also on a television monitor screen.

Under these circumstances, there is an increasing need of the users thatthe users wish not only to display captured still images and movingimages on a television screen but also to view and listen to the images“passively” as in a television program, or to enjoy the images in a formof being imparted with stage effects or video and sound effects such asin a television program or a movie.

Here, a slide show display can be raised as a method of successivelydisplaying digital video image data without an operation of a user. Amethod disclosed in Japanese Laid-open Patent Publication 2002-281450 isproposed as a method of adding effects to this slide show display. ThisJapanese Laid-open Patent Publication 2002-281450 discloses, as aconventional example, a method of controlling display switching effectsin accordance with the display switching effect setting that is impartedbeforehand to still images, and also discloses a method by which theuser can freely change to other display switching effects, and the like.

However, the technique proposed in Japanese Laid-open Patent Publication2002-281450 requires a work of the producer of the contents to addeffects in order to add effective display effects to a slide show. Forthis reason, according to the technique disclosed in Japanese Laid-openPatent Publication 2002-281450, the user can merely exchange theswitching effect controlling commands of still images with otherswitching effect controlling commands. In other words, the prior artraises a problem in that it is difficult to produce the display effectssuitable for the contents of individual photographs automatically or ina simple manner.

SUMMARY OF THE INVENTION

Thus, an object of the present invention is to provide an imagedisplaying method and an image displaying apparatus capable ofautomatically setting the display effects suitable for photographs onthe basis of the information proper to individual images in performing aslide show in a displaying apparatus.

In order to achieve the aforementioned object, the first invention ofthe present invention is an image displaying method comprising:

an image inputting step of inputting an image;

a characteristic area detecting step of detecting characteristic areasin the image;

a display effect selecting step of selecting a display effect from aplurality of predetermined display effects on the basis of the numberand/or size of the characteristic areas; and

a displaying step of displaying the image while changing the image inaccordance with the selected display effect.

The second invention of the present invention is an image processingmethod comprising:

an image inputting step of inputting an image;

a characteristic area detecting step of detecting characteristic areasin the image;

a display effect selecting step of selecting a display effect from aplurality of predetermined display effects on the basis of the numberand/or size of the characteristic areas; and

a video image signal outputting step of outputting a video image signalfor displaying the image while changing the image in accordance with theselected display effect.

In addition, the present invention includes a computer program formaking a computer execute the image displaying method according to thefirst invention and/or the image processing method according to thesecond invention, and a recording medium that stores this computerprogram.

The third invention of the present invention is an image displayingapparatus comprising:

displaying means for displaying an image;

image data obtaining means for obtaining image data;

characteristic area detecting means for detecting characteristic areasin the image;

display effect selecting means for selecting a display effect from aplurality of predetermined display effects on the basis of the numberand/or size of the characteristic areas; and

display controlling means for displaying the image on the displayingmeans while changing the image in accordance with the selected displayeffect.

The fourth invention of the present invention is a television-receivingapparatus including an image displaying apparatus according to the thirdinvention and a tuner section for outputting video image data byreceiving a digital broadcast, wherein the display controlling meanscontrols to display a video image on the displaying means on the basisof said video image data.

The fifth invention of the present invention is an image processingapparatus comprising:

image data obtaining means for obtaining image data;

characteristic area detecting means for detecting characteristic areasin the image;

display effect selecting means for selecting a display effect from aplurality of predetermined display effects on the basis of the numberand/or size of the characteristic areas; and

display controlling means for outputting a video image signal fordisplaying the image on displaying means while changing the image inaccordance with the selected display effect.

According to the image displaying method and the image displayingapparatus of the present invention, the display effect for displaying animage in a slide show can be made a more effective one reflecting thecontents of the image without requiring the user to perform a cumbersomesetting operation.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention, together with further advantages thereof, may best beunderstood by reference to the following description taken inconjunction with the accompanying drawings in which:

FIG. 1 is a block diagram showing a construction of a televisionreceiver according to the first embodiment of the present invention;

FIG. 2 is a schematic line view showing a remote controlling device ofthe television receiver according to the first embodiment of the presentinvention;

FIG. 3 is a flow chart showing an operation of a display control sectionaccording to the first embodiment of the present invention;

FIG. 4 is a schematic line view showing an example of an informationtable used for decision of the parameters of the display effects by thedisplay control section according to the first embodiment of the presentinvention;

FIGS. 5A to 5C are schematic line views showing a function of a displayeffect selection process according to the first embodiment of thepresent invention;

FIGS. 6A to 6H are schematic line views showing a display exampleaccording to the first embodiment of the present invention;

FIG. 7 is a schematic line view showing an example of an informationtable used for decision of the parameters of the display effects by thedisplay control section according to the second embodiment of thepresent invention;

FIGS. 8A to 8D are schematic line views showing a function of a displayeffect selection process according to the second embodiment of thepresent invention;

FIGS. 9A to 9H are schematic line views showing a display exampleaccording to the second embodiment of the present invention;

FIG. 10 is a block diagram showing a digital television receiveraccording to the third embodiment of the present invention;

FIGS. 11A and 11B are views showing an example of a monitor of a digitalcamera that can record an in-focus position in the third embodiment ofthe present invention;

FIGS. 11C and 11D are schematic line views showing an example in storingoperation history information in the third embodiment of the presentinvention;

FIG. 12 is a flow chart showing an operation of a display controlsection according to the third embodiment of the present invention;

FIG. 13 is a schematic line view showing an example of an informationtable used for decision of the parameters of the display effects by thedisplay control section according to the third embodiment of the presentinvention;

FIGS. 14A and 14B are schematic line views showing an example of afunction of a display effect selection process according to the thirdembodiment of the present invention; and

FIGS. 15A and 15B are schematic line views showing an example of amonitor screen of a digital camera having an image capturing mode fordesignating an imaging-object position according to another example ofthe third embodiment of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereafter, embodiments of the present invention will be described withreference to the attached drawings. Here, in all of the views of thefollowing embodiments, the same or the corresponding parts will bedenoted with the same reference numerals.

First Embodiment

First, a digital television receiving apparatus serving as an imagedisplaying apparatus according to the first embodiment of the presentinvention will be described. FIG. 1 shows a digital television receivingapparatus according to this first embodiment.

(Construction of Digital Television Receiving Apparatus)

Referring to FIG. 1, a signal received from an antenna (not shown) isinput into a tuner section 101. Tuner section 101 performs processessuch as demodulation and correction of errors on the input signal andcreates a digital data in a form called a transport stream. Tunersection 101 further performs a descrambling releasing process on thecreated transport stream (TS) data and outputs the processed data to ademultiplexer section 102.

Video image data and sound data for a plurality of channels as well aselectronic program guide (EPG) data and others are supplied from tunersection 101 to demultiplexer section 102. Also, demultiplexer section102 extracts video image data and sound data from the time-divided andmultiplied TS data such as the data supplied from tuner section 101 andbroadcasting data, and outputs the extracted data to a video/sounddecoder 103. The video image data processed by the video/sound decoderare written into a video memory 107, and output to a displayer 112 via adisplay synthesis section 108. On the other hand, the sound data aresupplied to a sound output section 104.

In this first embodiment, the displayer 112 to be used is constituted ofpixels with lateral 960 pixels and longitudinal 720 pixels (960×720pixels) Here, this number of pixels is only an example, so that one canuse a displayer 112 having any number of pixels.

A card slot 109 is an interface that is connected to a removable memorycard or the like and is used for exchanging data with a digital camera,for example. An image data input section 105 is a circuit for readingdigital image data from a memory card that is connected to card slot109. An image decoder 106 is a circuit for performing a decoding processon the digital image data that are input from the image data inputsection.

A display control section 110 is process controlling means for giving aninstruction of reading images to image data input section 105, giving aninstruction of executing a process to image decoder 106, writing displaydata into video memory 107, giving an instruction of a synthesizingprocess to display synthesis section 108, and giving an instruction ofstoring information to a storage section 113.

Further, display control section 110 includes a computer so as to obtaininput data from a remote controller 114 via a user input section 111 andto obtain image-capturing data imparted to digital image data via imagedata input section 105. Here, these constituent elements need notnecessarily be housed as an integrated unit. Specifically, for example,it is possible to adopt a construction in which a hard disk drive (HDD)or a set top box (STB) serving as image processing apparatusesincorporating a HDD is housed as a unit separate from the displayer,wherein a video image signal for displaying a video image is transmittedfrom the image processing apparatus to the displayer.

One example of this remote controller 114 is shown in FIG. 2. Here, inFIG. 2, only the buttons that perform operations to realize thefunctions necessary for the description of the first embodiment areshown. Therefore, the buttons needed in remote controller 114 in anactual receiving apparatus are not limited to those shown in FIG. 2.

As shown in FIG. 2, a light-emitting section 201 is light-emitting meansfor performing infrared ray communication between the remote controllerand a light-receiving section of user input section 111 shown in FIG. 1.A power source key 202 is switching means for turning the power on/off.A cursor/decision key 203 is a key for moving a cursor on a screen ormaking decisions at predetermined positions, where a decision key isdisposed at the center of the up, down, left, and right keys. Up anddown keys 204 and 205 are respectively made of two Up/Down keys. Numberkeys 206 are a series of numerals 1, 2, . . . , 9, 0 arranged in amatrix form. A color key 207 is made of four buttons colored in blue,red, green, and yellow that are arranged in a lateral row.

A monitor mode key 208 is a key for switching a display mode of amonitor of the television receiver. A “viewer” key 209 is a key forrecalling an image viewer function.

The digital images used in this first embodiment are, for example, stillimage data captured with a digital camera. These still image data aredata subjected to a compression process into predetermined imagecompression form data, for example, data subjected to a JPEG compressionprocess, by a digital camera. After being subjected to the compressionprocess, the still image data are recorded into a memory card as a stillimage data file. Here, in the following description, an “image file”represents still image data. Also, for simplification of thedescription, the still image data used in this first embodiment are allassumed to be data having a size of 1600×1200.

(Description of Processing Operation)

Next, a processing operation according to the first embodiment will bedescribed.

The display of digital images in digital television receiving apparatus100 according to the first embodiment is started, for example, byrecalling an image viewer function when a memory card is mounted to cardslot 109 by a user and a remote controller is operated. FIG. 3 showspart of an operation of the image viewer function of the digitaltelevision receiving apparatus according to the first embodiment. Here,in FIG. 3, mainly the operation of display control section 110 will beshown.

(Start of Slide Show)

When “viewer” key 209 of the remote controller shown in FIG. 2 ispressed by a user, the process shown in FIG. 3 is started by displaycontrol section 110.

First, in step S301, display control section 110 reads out the totalnumber of image files stored in the memory card inserted in card slot109 via image data input section 105, and this value is stored. Next,the procedure goes successively to step S302 and step S303, whereby thefirst sheet of image file is read out and the image size is obtained.Thereafter, the procedure goes to step S304, where display controlsection 110 supplies image data to image decoder section 106, and thisimage decoder section 106 executes a decoding process on the image data.Subsequently, the procedure goes to step S305, where a face detectionprocess is executed using the image subjected to the decoding process.Here, this face detection process will be described in detail below.

(Face Detection Process)

Namely, this face detection process according to the first embodiment isa process of searching for an eye or mouth pattern constituting thecharacteristics of a face in an image and, when the pattern coincideswith a predetermined pattern, confirming the presence or absence of skincolor and the presence or absence of an outline to determine whether thepattern constitutes a face or not.

In this first embodiment, this face detection process is executed as instep S305 a to step S305 e of FIG. 3. Namely, when it is determined as aface in this face detection process, the number of detected faces isincremented by one, and this number of the detected faces together withthe positional information of the face ((X, Y) coordinates with a basepoint at the upper left end of the image data) are respectively storedin storage section 113.

(Effect Decision Process Corresponding to the Number of Detections)

When the face detection process on the first sheet of the image isfinished, the procedure goes to step S306, where a display effectselection process on the first sheet is executed on the basis of theresult of the face detection process. In this first embodiment, adisplay effect corresponding to the number of detected faces is selectedusing a table shown in FIG. 4.

Specifically, for example, if the number of detected faces is one, adisplay effect process of “display whole→zoom to face position” isselected by display control section 110 in accordance with the tableshown in FIG. 4. If the number of detected faces is two, a displayeffect of “pan on the line passing through the two faces in a zoomedstate” is selected. Further, if the number of detected faces is three ormore, a display effect of “zoomed display of the center-of-gravityposition of all the face positions→zoom out to the whole image” isselected. If no face has been detected, a display effect of “displaywhole→zoom out” is selected. Here, the terms “zoom” and “zooming” inmeaning are not limited to execution of an enlargement process bycutting out a part of the image data. Namely, in the case of an imagedata of “1600×1200” used as one example in this first embodiment, thestate in which this image data is subjected to a contraction process todisplay the data over the whole screen (960×720) is considered as abase, and a process of letting the image appear partially enlargedrelative to this whole screen will be referred to as “zoom” or“zooming”. Specifically, the process of “display whole→zoom to faceposition” is a process of first diminishing the image data of“1600×1200” to ⅗ of the original one to display the image over the wholescreen (960×720) and then changing the magnification so that the displaywill always be “960×720” while diminishing the cut-out area of theimage.

(Display Effect Process)

When such a display effect selection process is finished, the proceduregoes to step S307, where the pictures of the display data are drawncontinuously while changing the condition on the video memory on thebasis of the selected display effect and the positional information ofthe face stored in the storage section, and the display effect processaccording to this is executed. Here, when the display effect processdescribed below is ended, step S303 to step S307 are repeated until aninstruction for an end (end instruction) is given by the user'soperation of the remote controller or until the successively countednumber N of the processed images reaches the total number of the images(S308 to S310). At the stage when the number N of the processed imagesexceeds the total number of the images, the display effect process isexecuted from step S302.

An appearance of the display effect process performed by display controlsection 110 is shown in FIG. 5. FIG. 5A shows a case in which the resultof:

number of detected faces: 1

face position: (674, 288)

is obtained by the face detection process when the image data isprocessed. In this FIG. 5A, the result of “number of detected faces: 1”is obtained by the above-described process, and the display effect of“display whole→zoom to face position” is selected on the basis of this.Display control section 110 executes a zooming process to the faceposition from the display of whole on the selected image.

Namely, first the area shown by “a” in FIG. 5A is displayed over thewhole screen, and continuous drawing of pictures is executed on thevideo memory while the magnification is gradually increased. Thispicture drawing process is ended when the displayed area reaches thearea shown by “b”.

When the display effect process on this first sheet is finished, displaycontrol section 110 executes a similar process on the second andsubsequent sheets of images. For example, if the second sheet ofphotograph is an image data such as shown in FIG. 5B, a result of:

number of detected faces: 2

face positions: (650, 456), (840, 596)

is obtained by the face detection process. When the result of “number ofdetected faces: 2” is obtained by the above-described process, thedisplay effect of “pan on the line passing through the two faces in azoomed state” is selected by the face detection process. By this,display control section 110 executes a panning process on the selectedimage. Here, the line in “on the line” is preferably a straight line;however, other lines can be set as well.

Namely, in a state in which the image is zoomed, continuous drawing ofpictures is executed on the video memory so that the displayed areagradually moves from area “d” to area “e” while travelling on the lineshown by “c” that passes through the two face positions in FIG. 5B.

If the third sheet of photograph is an image data shown in FIG. 5C, aresult of:

number of detected faces: 3

face positions: (826, 320), (1171, 421), (476, 392)

is obtained by the face detection process. When the result of “number ofdetected faces: 3” is obtained by the above-described process, thedisplay effect of “zoomed display of the center-of-gravity position ofall the face positions→zoom out to the whole image” is selected by theface detection process. By this, display control section 110 executes azooming-out process on this image.

Namely, an area having a center at the position shown by “f” in FIG. 5C(area of “g” in FIG. 5C) is displayed in zoom, and thereafter continuousdrawing of pictures is executed on the video memory so as to zoom outgradually to the whole lower image (area of “e” in FIG. 5).

One example of the display result by such a process of display controlsection 110 is shown in FIG. 6. FIGS. 6A to 6D in this order show thestates of the display of the image shown in FIG. 5A. FIGS. 6E to 6H inthis order show the states of the display of the image shown in FIG. 5B.

As shown in FIG. 6, according to the first embodiment, by an operationof the display control section, in a slide show that can selectivelyswitch among a plurality of display effects, a display effect can beselected reflecting the number of faces contained in individual imagesand, in actual display effect processes, a process reflecting thepositions of the faces can be executed.

Second Embodiment

Next, an image displaying method and an image displaying apparatusaccording to the second embodiment of the present invention will bedescribed.

Instead of detecting the. “number of faces” and “positions” by the facedetection process and selecting and controlling the display effects onthe basis of the “number of faces” and “positions” as in the firstembodiment, the second embodiment adopts a construction in whichinformation on the “size of face area” is detected and stored into thestorage section in addition to the “number of faces” and “positions”.

Further, in the second embodiment, a condition is added to the displayeffect selection process. FIG. 7 shows one example of a display effectselection process in which the condition of “size of face area” is addedto the “number of faces”.

Namely, As shown in FIG. 7, when the number of detected faces is oneafter the face detection process, if the size of a face area is largerthan or equal to a predetermined value, for example, if the width is 130or more, a process of “display whole→zoom to face position” is selected.On the other hand, if the size of the face area is smaller than thepredetermined value when the number of detected faces is one, a processof “window frame display only for the neighborhood of the facearea→enlarge the frame for display of whole” is selected.

(Display Effect Process)

Next, the display effect process according to the second embodiment willbe described. Namely, suppose that the result of:

number of detected faces: 1

face position: (557, 496)

size of face area: width 252, height 228

is obtained by the face detection process executed as described above,for example, in processing the image data shown in FIG. 8A.

In this case, on the basis of the result of “number of detected faces:1” and that the size of the face area is larger than or equal to thepredetermined value by the above-described process according to thesecond embodiment, a display effect of “display whole→zoom to faceposition” is selected. Then, display control section 110 executes azooming process to the face position from the display of whole on thisimage.

Namely, first the area defined by “a” shown in FIG. 8C corresponding toFIG. 8A is displayed over the whole screen. Thereafter, themagnification is gradually increased and continuous drawing of picturesis executed on the video memory. This picture drawing process is endedwhen the displayed area reaches the area defined by “b” shown in FIG.8C.

On the other hand, suppose that the result of:

number of detected faces: 1

face position: (674, 288)

size of face area: width 124, height 102

is obtained by the face detection process in processing the image datashown in FIG. 8B.

In this case, on the basis of the result of “number of detected faces:1” and that the size of the face area is smaller than the predeterminedvalue by the above-described process, a display effect of “window framedisplay only for the neighborhood of the face area→enlarge the frame fordisplay of whole” is selected. Then, display control section 110executes a zooming process to the face position from the display ofwhole on this image. Namely, the display effect selection at this timeis processed by comparing the size of the face area with a thresholdvalue based on the image resolution.

Namely, first the display is carried out so that only the inside of theframe defined by “c” shown in FIG. 8D corresponding to FIG. 8B isexposed. Thereafter, continuous drawing of pictures is executed on thevideo memory while the size of the frame is gradually enlarged. Thispicture drawing process is ended when the whole image is displayed.

The display result by the process of display control section 110 such asshown above will specifically be as shown in FIG. 9, for example.Namely, regarding the display of the image of FIG. 8A, the display iscarried out successively as shown in FIG. 9A to FIG. 9D and, regardingthe display of the image of FIG. 8B, the display is carried outsuccessively as shown in FIG. 9E to FIG. 9H.

As described above, according to the second embodiment, an effectsimilar to that of the first embodiment can be produced. Also, by anoperation of display control section 110, in a slide show that canselectively switch among a plurality of display effects, not only adisplay effect can be selected reflecting the number of faces containedin individual images but also a different display effect can beimplemented depending on the size of the face area.

However, in the case of an image having a small face area, when azooming process is carried out until the face has a sufficient size, themagnification may become larger than one, whereby a block noise or thelike may become conspicuous which is generated by an image compressionprocess, specifically, in performing a JPEG compression process, forexample. If an impression on such display inconvenience becomes strong,it will not be “effective” on the user side even if a zooming process iscarried out to the face position.

Therefore, this second embodiment is constructed in such a manner that,if the face area is smaller than a predetermined value, a differentdisplay effect such as shown in FIGS. 9E to 9H is selected withoutexecuting a zooming process, so as to draw pictures emphasizing on theface. By this picture drawing, the above-mentioned display inconveniencecan be prevented while ensuring the effect of emphasizing the face.

Third Embodiment

Next, an image displaying method according to the third embodiment ofthe present invention will be described. This third embodiment isconstructed to use, in addition to the face detection process,image-capturing information recorded when a photograph was taken andviewing/listening history information when the user viewed or listenedto the corresponding photograph before, unlike the first and secondembodiments in which the display effect is selected on the basis of theresult of the face detection process. FIG. 10 shows a construction of adigital television receiving apparatus 700 to which the invention isapplied. Here, the remote controller used in the third embodiment issimilar to the remote controller used in the first embodiment (See FIG.2), so that the description thereof will be omitted.

(Description of Each Section)

As shown in FIG. 10, a tuner section 701, a demultiplexer-section 702, avideo/sound decoder 703, a sound output section 704, an image data inputsection 705, a video memory 707, a display synthesis section 708, and acard slot 709 constituting the digital television receiving apparatus700 according to the second embodiment are similar to those of theabove-described first embodiment, so that the description thereof willbe omitted. Further, a displayer 712 used as one example in this thirdembodiment is made of lateral 960 pixels and longitudinal 720 pixels(960×720).

Namely, as shown in FIG. 10, an image decoder 706 is a circuit forperforming a decoding process on the digital image data supplied fromimage data input section 705. A display control section 710 is processcontrolling means for giving an instruction of reading images to imagedata input section 705 and giving an instruction of executing a processto image decoder 706. Further, display control section 710 is processcontrolling means for writing display data into video memory 707, givingan instruction of a synthesizing process to display synthesis section708, and giving an instruction of storing information to storage section713. Also, this display control section 710 is adapted to be capable ofobtaining input data from remote controller 714 via user input section711, and is further adapted to be capable of giving an instruction toimage data input section 705 for supplying data to an image-capturinginformation analysis section.

A face detection section 716 is a circuit that executes a processsimilar to the face detection process in the first and secondembodiments. An image-capturing information analysis section 717 is acircuit for obtaining “in-focus position” information that was addedwhen the image was captured, from an image file. An operation historystorage section 718 is a circuit for storing a past enlargementoperation history for each photograph. An attended area detectionsection 715 is constituted of these face detection section 716,image-capturing information analysis section 717, and operation historystorage section 718.

A monitor screen in digital television receiving apparatus 700 such asshown above will be described. FIGS. 11A and 11B show one example of amonitor screen of a digital camera used in the third embodiment.

Namely, when a display shown in FIG. 11A is carried out at the time ofcapturing an image, a record that the rectangular area on the left sidewas in focus is added to the image file. On the other hand, when adisplay shown in FIG. 11B is carried out at the time of capturing animage, a record that the rectangular area on the right side was in focusis added to the image file.

Also, if an operation of “enlarged display” of up key 204 of the remotecontroller is performed by the user when the user viewed or listened tothe photograph, area information of this “enlarged display” is stored asdata in operation history storage section 718. Specifically, forexample, when a photograph shown in FIG. 11C is displayed by beingenlarged as shown in FIG. 11D by the user's operation of the remotecontroller, the operation history information at this time is stored asinformation with center coordinates (450, 800) and size (width W: 800,height H: 600) The other configuration is the same as in the first andsecond embodiments, so that the description thereof will be omitted.

(Processing Operation)

Next, a processing operation in the image displaying method according tothe third embodiment of the invention will be described. The display ofdigital images in digital television receiving apparatus 700 accordingto the third embodiment is started by recalling an image viewer functionwhen a memory card is mounted to card slot 709 by a user and a remotecontroller is operated. Here, in the following description, forsimplification thereof, the number of pixels in the used image data isassumed to be 1600×1200. FIG. 12 shows part of an operation of the imageviewer function of the digital television receiving apparatus. In FIG.12, mainly the operation of display control section 710 will be shown.

(Start of Slide Show)

First, when “viewer” key 209 of the remote controller shown in FIG. 2 ispressed by a user, the process shown in FIG. 12 is started by displaycontrol section 710.

In the process shown in FIG. 12, first, in step S1201, display controlsection 710 reads out the total number of image files stored in thememory card inserted in card slot 709 via image data input section 705,and this value is stored into storage section 713. Next, after thenumber of images is set to be N=1 in step S1202, the procedure goes tostep S1203, where the first sheet of image file is read out and theimage size is obtained.

Thereafter, the procedure goes to step S1204, where display controlsection 710 supplies image file data from the image data input sectionto the image-capturing information analysis section, and requests theimage-capturing information analysis section 717 to analyze theimage-capturing information that was recorded when the image wascaptured. As a result of this analysis, an in-focus position isobtained, and this position is stored in storage section 713.

Next, the procedure goes to step S1205, where display control section710 supplies the image data to image decoder 706, and a decoding processis started. Subsequently, the procedure goes to step S1206, where theimage subjected to the decoding process is supplied to the facedetection section, and display control section 710 gives an instructionto face detection section 716 to execute a face detection process on theimage subjected to the decoding process. Then, as a result of this facedetection process, the number of faces, the positions thereof, and thesizes thereof are obtained and stored into storage section 713.

Further, the procedure goes to step S1207, where display control section710 searches operation history storage section 718 on whether theoperation history on the corresponding image is present or not. If it isfound by this search that there is a past history of enlargement displayof the corresponding image, the center coordinates and the size areobtained and stored in storage section 713.

(Effect Decision Process)

Thereafter, the procedure goes to step S1208, and when the facedetection process on the first sheet of image, the image-capturinginformation analysis process, and the operation history obtainingprocess are finished, a display effect selection process is executed onthe first sheet on the basis of these results. In the third embodiment,a table shown in FIG. 13 is used, and a display effect corresponding tothe presence or absence of the duplication of respective areas and thenumber of areas is selected.

Specifically, for example, when a duplicated area is one among the facedetection position, the in-focus position, and the enlargement operationposition, a display effect process of “display whole→zoom to theduplicated area (magnification: high)” is selected in accordance withthe table of FIG. 13. When the number of duplicated areas is two, adisplay effect of “pan on the line passing through the two duplicatedareas in a zoomed state (magnification: high)” is selected. When thenumber of duplicated areas is three or more, a display effect of“display whole→zoom to the first area (magnification: high), then pan tothe second and subsequent areas” is selected.

When there are no duplicated areas and only one area has been detectedin the face detection process, the image-capturing information analysisprocess, and the operation history obtaining process, a display effectof “display whole→zoom to the duplicated area (magnification: low) isselected. On the other hand, when there is no duplication though thereare two areas, a display effect of “pan on the line passing through thetwo duplicated areas in a zoomed state (magnification: low)” isselected. When there is no duplication though there are three or moreareas, a display effect of “zoomed display of the center-of-gravityposition of all the areas→zoom out to the whole image” is selected.

(Display Effect Process)

Next, when the display effect selection process is finished, theprocedure goes to step S1209, where the pictures of the display data aredrawn continuously while changing the condition on the video memory onthe basis of the selected display effect and the positional informationof the face stored in storage section 713, and the display effectprocess is executed. An appearance of the display effect processperformed by display control section 110 is shown in FIG. 14. Here, whenthe display effect process described below is ended, step S1203 to stepS1209 are repeated until the user gives a request for an end or untilthe number N of the processed images reaches the total number of theimages (S1210 to S1212). At the stage when the number N of the processedimages exceeds the total number of the images, the display effectprocesses from step S1202 onwards are executed.

Namely, for example, when the image data shown in FIG. 14A areprocessed, if the area shown by “a” in FIG. 14A is an in-focus positionobtained from image-capturing information analysis section 717 and thearea shown by “b” in FIG. 14A is an enlarged display area obtained fromoperation history storage section 718, the duplicated area is one, asshown by “c” fin FIG. 14A. Therefore, a display effect of “displaywhole→zoom to the duplicated area (magnification: high)” is selected inaccordance with the table of FIG. 13. By this, a zooming process on theduplicated area is executed as shown in FIG. 14B.

As described above, in a slide show in which a plurality of displayeffects can be selectively switched, by the operations of the facedetection section, the image-capturing information analysis section, theoperation history storage section, and the display control sectionaccording to the third embodiment, a display effect can be selected andimplemented reflecting the number and position of each information ofthe face detection positions, the in-focus positions, and the enlargingoperation positions contained in individual images, as well as theduplication relationship thereof.

Specifically, for example, if an in-focus position is present induplication in the same area as the face detection position, there is ahigher possibility that the user is paying attention to the area, ascompared with the case in which only the information on the facedetection position is present. In this case, a display effect can beselected and executed to emphasize more strongly the area where thein-focus position is present in duplication, such as a zooming displayat a higher magnification than in the case in which only the facedetection position information is present.

On the other hand, if the face detection positions, the in-focuspositions, and the enlarging operation positions are in different areas,there is a possibility that the attended areas for the user aredispersed. Therefore, a display effect can be selected and executed todisplay each area at all times without displaying to emphasize aspecific area strongly.

As shown above, the embodiments of the present invention have beenspecifically described; however, the invention is not limited to theabove-described embodiments alone, so that various modifications can bemade based on the technical idea of the invention.

For example, the numerical values raised in the above-describedembodiments are merely examples, so that numerical values different fromthese can be used in accordance with the needs.

For example, in the above-described first embodiment, a method ofdetecting a skin color is used in determining whether an area is a faceor not as a face detection process; however, according to the purport ofthe invention, the method is not limited to this, so that other methodsmay be employed instead.

Also, for example, in the above-described first embodiment, an examplehas been described in which the process is proceeded in the order of thereading process of the image data, the face detection process, theeffect decision process, and the display effect process. However, on thebasis of the technical idea of this invention, it is not necessarilylimited to this example. For example, it is possible to execute thereading process of the (N+1)th image data, the face detection process,and the effect decision process in parallel while executing the Nthdisplay effect process.

Further, for example, in the above-described second embodiment, a valueof “130” is used as a threshold value for determining the size of theface area. However, this threshold value is one example of a thresholdvalue determined based on the image resolution of “1600×1200” used inthe above-described second embodiment, so that the threshold value fordetermining the size of the face area is not necessarily limited to thenumerical value of 130, so that various values can be selected based onthe purport of the invention. In particular, in the case of using animage having a resolution other than the image resolution (1600×1200)used in the second embodiment, it is preferable to adopt a differentnumerical value. Also, in the case where a plurality of imageresolutions are intermixed, after each image size is obtained, a valuecorresponding to the resolution thereof is used.

Also, for example, in the above-described third embodiment, an examplehas been described in which information of focus position informationrecorded at the time of image capturing is used. However, if for examplethe construction of the digital camera can set a mode in which theimaging-object position or a focus position is fixed as an imagecapturing scene mode, it is possible to use information of this imagecapturing scene mode. Specifically, for example, as shown in FIG. 15, ifan image is captured using a digital camera equipped with an imagecapturing scene mode such as “person is on the right” or “person is onthe left” and if information that “person is on the right” is present inan Exif header information of the image, it is possible to store theright side of the photograph as the imaging-object position in thestorage section, for use in the display effect selection process.

In the above-described embodiments, examples have been described inwhich the invention is applied to a digital television receivingapparatus; however, the technical idea of the invention is not limitedto this digital television receiving apparatus, so that it can be used,for example, in a form of a set top box for reproducing images capturedby a digital camera or in a form of a software of a personal computer orthe like. Further, it can be used in a form of a digital camera or thelike having a slide show reproduction function.

This application claims priority from Japanese Patent Application No.2003-418542 filed Dec. 16, 2003, which is hereby incorporated byreference, herein.

1. An image displaying method comprising: using an image processingapparatus to implement the following steps: an image inputting step ofinputting a plurality of still images; a facial area detecting step ofdetecting facial areas of persons in each of the plurality of images; adisplay effect selecting step of selecting a display effect from aplurality of predetermined display effects for each of the plurality ofthe still images on the basis of the number of the facial areas detectedin each still image; and a display controlling step of a running slideshow of the plurality of the still images in accordance with the displayeffect selected with respect to each of the still images, wherein, inthe display effect selecting step, if one facial area is detected in thestill image a display effect of zooming the facial area is selected, andif several facial areas are detected in the still image a display effectof panning on the several facial areas is selected.
 2. An imagedisplaying method of claim 1, wherein if one facial area is detected inthe facial area detecting step, a display effect of zooming the facialarea is selected in case the size of the facial area is larger than apredetermined size, and the display effect of zooming the facial area isnot selected in case the size of the facial area is smaller than thepredetermined size in the display effect selecting step.
 3. An imagedisplaying method of claim 1, further comprising an in-focus positionobtaining step of obtaining information of and in-focus position foreach of the still images, wherein magnification of the zooming effectselected in the display effect selecting step is larger when the facialarea in the still image overlaps with the in-focus position than whenthe facial area does not overlap with the in-focus position.
 4. An imagedisplaying method of claim 1, further comprising an operation historyobtaining step of obtaining operation history information regarding anenlarged position where an enlarged display is performed by useroperation, wherein magnification of a zooming effect selected in thedisplay effect selecting step is larger when the facial area in thestill image overlaps with the enlarged position than when the facialarea does not overlap with the enlarged position.
 5. A computer-readablemedium storing a computer-executable program implementing a methodaccording to claim
 1. 6. An image displaying apparatus comprising:displaying means for displaying an image; image data obtaining means forobtaining a plurality of still image data; facial area detecting meansfor detecting facial areas of persons in each of the plurality of stillimages; display effect selecting means for selecting a display effectfrom a plurality of predetermined display effects for each of theplurality of the still images on the basis of the number of facial areasdetected in each still image; and display controlling means fordisplaying running a slide show of the plurality of still images on thedisplaying means in accordance with the display effect selected withrespect to each of the still images; wherein if one facial area isdetected in the still image the display effect selecting means selects adisplay effect of zooming the facial area, and if several facial areasare detected in the still image the display effect selecting meansselects a display effect of panning on the several facial areas.